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1, INTRODUCTION 

To extract valid information from video, without any loss of information, much attention is being 
paid to video processing technology. For this Key Frame is very useful technique. Extracting a small 
numbers of key frames that can abstract the content of video is very important for efficient browsing and 
retrieval in video database. Video processing techniques can be used to remove redundant frames from video 
so that it will solve the problem of the data storage [1]. Key frame extracting based on threshold technique 
where the calculated threshold is brought out in comparison with the difference histogram of the image [2]. 
An effective and efficient content based key frame detection method based on content analysis and feature 
detection from key frame proposed in [3]. Select and extract key frames from news video shot based on 
dissimilarity between each pair of consecutive frames was presented in [4]. Another approach for key frames 
extraction from video based on Faber-Schauder coefficients and singular value decomposition presented 
in [5] through the key frame sequence detection and identification, the sign language can be rapidly 
recognized. At the same time, sign language is a way for deaf people to communicate and exchange ideas 
through finger alphabet and gestures instead of language [6]. Key frame extraction method based on 
unsupervised clustering and mutual comparison were developed in [7]. A method of key frame extraction 
using thresholding of absolute difference of histogram of consecutive frames of video data was proposed [8]. 
Key frame extraction method using DWT wavelet statistics was proposed in [9]. The key frames are found by 
computing the edge difference between the consecutive frames and those frames exceeding the threshold are 
considered as key frame [10]. 

In this study, a New Method Hybrid DWT-Edge Key Frame Detection (HDEKFD) of dynamic sign 
language is proposed. This method combined two algorithms edge detection and DWT to increase processing 
speed by reduce the numbers of redundant frames. Simulation results illustrate the efficient of the proposed 
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algorithm compare to other methods. This paper is organized as follows. Section 2 shows some method for 
key frame extraction. Section 3 presents the proposed method, and Section 4 briefly discusses the 
experimental results and Section 5 is the conclusion of this study in compare with the DWT wavelet method 
and the Edge detection method. 


2. GENERAL METHODS FOR KEY FRAME EXTRACTION 
This section described some of general methods used for key frame extraction: 


2.1. Key Frame Extraction Based on DWT Wavelet Statistics: 

The first step, the video frames are read and, then two consecutive frames transformed with DWT to 
obtain four sub bands, LL, HL, LH, and HH. Only three sub-bands, HL, LH, and HH are used to detect key 
frame. For each sub band different value is estimated by subtracting detail component values of current and 
next frame as shown in Equation 1. 


Dk) =, (CHa) — cH) 1 = 1,23 (1) 
where 1 and j are numbers of row and column, cH, are the HL, LH and HH band of gray images V, 


and cH),, are the HL, LH and HH band of gray images V;,,. In the second step, mean yp and standard 
deviation 0; are calculated from step one using difference values of sub bands Equation 2 and Equation 3. 
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The third step, threshold value y,for each sub band is computed by Equation 4. the last step a 
comparison between threshold and difference values then if two difference values of any two sub bands are 
greater than each related threshold, the last frame considered as a key frame. 


Y= b+ B.o% (4) 


2.2. Edge Detection 

In this method the video stream is taken as input convert into different images. MAfter this image is 
converted into edge detected using of one of the edge detection method. Canny detection method is used in 
this phase of key frame extraction. After that the edge difference between two successive frames are 
calculated and in this way the difference between all frames is calculated. Then the total accumulated 
difference is taken and by using that the mean of the total video is calculated. After that the standard 
deviation is calculated. The threshold is calculated depending on mean and standard deviation calculation 
then if the difference between two successive frames is greater than the threshold value the key frame is 
extracted. Figure 1 show the flowchart for key frame extraction using DWT method. Figure 2 shows the flow 
chart of the key frame extraction based on edge detection method. 


3. PROPOSED METHOD HYBRID DWT-EDGE KEY FRAME DETECTION 

The proposed method Hybrid DWT-Edge Key Frame Detection (HDEKFD) comprises two phase, 
the first phase is the key frame extraction based on discrete wavelet method. The output files from this phase 
is taken as input to the second phase that key frame extraction based on edge detection as shown in figure. 
Figure 3 show the the block diagram of key frame extraction based on (HDEKFD) method. 


Key frame extraction using hybrid algorithm of dynamic sign language (Hussein Ali Aldelfy) 


188 0 ISSN: 2502-4752 
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Figure 1. Flowchart for key frame extraction using DWT method. (Phase 1) 


Input key frames from 
phase 1 







Compute edge difference 


Discard frame 
YES 


Compute Fk+1 as output frames 










Calculate 
Threshold 







Store 
Extracted 
keyframes 


Figure 2. Flowchart for key frame extraction based on edge detection method (phase 2) 
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Figure 3. The block diagram of key frame extraction based on (HDEKFD) method 


4. THE EXPERIMENTAL RESULTS 

In this section of research is indicative words belong to Deaf and dumb people, these words were 
collected in Arabic language and Iraqi dialect and individual words in collaboration with Iraqi Ministry of 
labour and Social Affairs. More than forty words signalled task in dealing one word is used as an example, 
water word IS used as inputs to the proposed system also been using MATLAB program 2013b in the 
implementation of the proposed algorithm. The water video is 11.9 MHz and 5 second time length and 30 
frame /sec. The comparative results of key frame extraction based on (HDEKFD) method with other methods 
is illustrated In Table 1. 


Table 1. Comparative Results 


Method No of frames in video Key frame No 
Discrete Wavelet method 174 34 
Edge detection method 174 Zt 
(HDEKFD) method 174 10 


The key frame extraction of DWT wavelet method shown in Figure 4. The number of images 
about 34 image. Figure 5 shows the key frame extraction based on edge detection method and the number of 
images resulted about 27 images. Figure 6 shows the key frame extraction based on the (HDEKFD) proposed 
method and the number of images resulted about (10) images. 
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Figure 4. Key frame extraction based on discrete wavelet method 
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Figure 5. Key frame extraction based on Edge detection method 
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Figure 6. Key frame extraction based on HDEKFD method 


5. CONCLUSION 

In this paper key frame extraction based on (HDEKFD) method is presented. The Aim of this 
method is to reduce the redundant frames that can lead dimensionality reduction of feature vector 
classification of an isolated Arabic word for deaf and dump peoples. According to the experimental results, 
the (HDEKFD) Method is effective in reduction of key frames in comparison with two methods and this 
result leads to an effective reduction in time consuming in processing time and reduction of storage capacity. 
As our future work, we will continue in our research for pattern recognition of sign language based on the 
resulted key frames from a used video clips. 
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